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DETAILED ACTION 

1 . Claims 6-10 and 33-41 are pending in tliis application. 



Response to Arguments 

2. Applicant's arguments filed 04/04/2008 have been fully considered but they are 
not persuasive. 

Applicant argues "Examiner rejects claims 6-10 and 33-41 under 35 U.S.C. § 
103(a) as being unpatentable over Eakins in view of U.S. Patent No. 6,801,641 to 
Eraslan (hereinafter "Eraslan") and further in view of Japanese Patent JP 06-215105 to 
Haruo (hereinafter "Haruo"). This rejection is respectfully traversed. In addition to the 
foregoing remarks provided by the previous responses, we provide the following: 
The present invention relates to searching for an image or sequence of images (still or 
video image) containing a specific object of interest to the searcher. This is done by 
searching through stored representations of images or sequences of images. The 
stored representations represent each image or sequence of images by an object 
descriptor of an object in the image or sequence of images. The object descriptor 
includes a plurality of view descriptors (associated together to form the object 
descriptor) which are descriptors of two-dimensional views of the object in the image or 
sequence of images from different perspectives. For example, the object descriptor 
includes a view descriptor of the object as it appears in the image or sequence of 
images (one two-dimensional perspective view) and view descriptors of the object in 
other two-dimensional perspective views (not appearing in the image or sequence of 
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images). Tliis can be done, for example, by a person viewing tlie image or sequence of 
images; wlio recognizes tlie object in tlie image and tlie perspective view (sucli as a top 
view of a car) and associates descriptors of otiier views of a car (side, rear, underneatli, 
etc), tlie views being tal<en, for example, from a general database, and not from the 
subject image or sequence of images. A search is initiated by inputting a query, which is 
a query descriptor of an object. The query descriptor is a representation of a specific 
object in a specific two-dimensional perspective view. The query descriptor is then 
compared with the stored object descriptors (for images or sequences of images) as 
described above. More specifically, for a stored object descriptor, the query descriptor is 
compared with each of the plurality of view descriptors in the object descriptor. If the 
query descriptor matches any of the view descriptors, the overall object descriptor is 
considered a match and the corresponding image or sequence of images is retrieved, 
even if the perspective view of this object in the query does not match the perspective 
view of the object in the image or sequence of images. None of Eakins, Eraslan or 
Haruo, alone or in combination, disclose the above features of the invention." 

The examiner respectfully disagrees with the above argument. Eakins discloses 
searching an image using similarities matching of multi-component images. Fig. 1 in 
Eakins discloses image having an object, each of object include two dimensional. 
Further more, Eakins also discloses the query module to select a query image and run 
search parameters... page 4 where each of the query image is a two dimensional 
images of an object. Eraslan discloses method and system for retrieving and indexing 
the two dimensional object of an image with different perspective view for example in 
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fig. 8 wliicli includes five different views of a nose of a person eacli and eacli of tlie 
view being index. Tliese different views of nose include the two dimensional such as x 
and y. Haruo discloses creating a projection image to a two dimensional image flat 
surface which correspond to providing a plurality of stored image representations of 
tree-dimensional objects, each image representation being associated with an object 
descriptor, each object descriptor including a plurality view descriptors, each view 
descriptor of representing the outline of the shape of a projection of each one of the 
three-dimensional objects from a different perspective view of the three-dimensional 
object. Hero's teaching further re-enforce that each of the views of nose is image in 
Earlap representing the outline of the shape of each of the three-dimensional objects 
from a different perspective view of the three-dimensional object. Such combination 
from Eakins and Eraslan and Haruo to arrive to image retrieval of image using outline of 
an object. 

Moreover, in view of the guidance provided by the Supreme Court in KSR 
decision, the a patent claim is prima facie obvious if "some motivation or suggestion to 
combine the prior art teachings" can be found in the prior art, the nature of the problem, 
or the knowledge of a person having ordinary skill in the art. See the recent Board 
decision EX parte Smith, ~USPQ2d~, slip op. at 20, (Bd. Pat. App. & Interf. June 25, 
2007 (citing KSR, 82 USPQ2d at 1396) (available at 
<http://www.uspto.qov/web/offices/dcom/bpai/prec/fd071925.pdf> ). 
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Applicant also argues "Eakins is not concerned with different two-dimensional 
perspective views of a three- dimensional object in an image. Eakins is not concerned 
with identifying an object in an image or sequence of images and considering other 
views of the same object. Eraslan is primarily concerned with generating a three- 
dimensional facial image from constituent parts, and not with searching for an image or 
sequence of images containing an object of interest. Eraslan does not disclose an 
object descriptor including a plurality of associated view descriptors of an object in 
different two-dimensional perspective views. Neither Eraslan nor Easkins discloses or 
suggests searching by inputting a query descriptor representing a two-dimensional 
perspective view of a three-dimensional object and matching the query descriptor with 
each of said plurality of view descriptors in an object descriptor to identify a "matching" 
image or sequence of :stages. Similar comments apply to Haruo, which merely 
discloses converting three-dimensional shape data to a two-dimensional plane. There is 
no object descriptor with associated different two-dimensional perspective views, and 
no searching by matching a query descriptor with each of a plurality of associated view 
descriptors. None of Eakins, Eraslan or Haruo discloses or suggests retrieving an image 
sequence of images including an object in a first perspective view by matching with a 
query descriptor of the object in a different perspective view. " 

The examiner respectfully disagrees with the above argument. As described 
above, the combination of Eraslan suggests indexing an object (ear, nose or head) of 
an image different view (fig. 8). These images which are mug shot can be access 
remotely the law enforcement. Haruo's teaching further re-enforce that each of the 
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views of nose is image in Eraslan representing tlie outline of tlie sliape of eacli of tlie 
tliree-dimensional objects from a different perspective view of tlie tliree-dimensional 
object. Furtliermore, Eal<ins discloses searching an image using similarities matching 
of multi-component images. Fig. 1 in Eakins discloses image having an object, each of 
object include two dimensional. Further more, Eakins also discloses the query module 
to select a query image and run search parameters... (page 4), where each of the query 
image is a two dimensional images of an object. Such combinations yield result as 
applicant claimed invention as suggest in KRS above. 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed 
or described as set forth in section 102 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was 
made. 



3. Claims 6-1 0 and 33-41 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Eakins et al. (Retrieval of trade mark images by shape feature-the 
ARTISAN project) (May 22, 1996) in view of Eraslan (US. Patent No. 6,801,641 B2) 
and further in view of Haruo et al. (JP 06-215105 Pub. No. 05/08/1994). 
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Regarding on claim 6, Eal<ins teaclies a metliod of searcliing for an object in still 
or video image by processing signals corresponding to the images, the method 
comprising: 

Inputting a query in the form of at least a two-dimensional outline of an object (to 
allow formulation of visual queries) (page 2 of 9, line 35); 

Deriving a query object descriptor of the query object (search parameters 
extracts appropriate shape features from the query image) (page 4 of 9, line 33-34); 

Comparing said query object descriptor with at least one of said object 
descriptors (computes appropriate similarity scores between query and stored image by 
shape feature matching) (page 4 of 9, lines 34-35); 

Selecting and displaying at least one result corresponding to one of the image 
representations containing an object for which comparison between the associated 
object descriptor and the query object descriptor indicates a degree of similarity 
between the query object and said object (displays the most similarity retrieved images 
on the screen) (page 4 of 9, lines 37-37). 

Eakins does not explicitly teach providing a plurality of stored image 
representations of tree-dimensional objects, each image representation being 
associated with an object descriptor, each object descriptor including a plurality view 
descriptors, each view descriptor of representing the outline of the shape of a projection 
of each one of the three-dimensional objects from a different perspective view of the 
three-dimensional object. Eraslan teaches providing a plurality of stored image 
representations of tree-dimensional objects, each image representation being 
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associated witli an object descriptor, eacli object descriptor including a plurality view 
descriptors, each view descriptor of representing the outline of the shape of a projection 
of each one of the three-dimensional objects from a different perspective view of the 
three-dimensional (col. 4, lines 2-8). Therefore, it would have been obvious to one 
ordinary skill in the art at the time of the invention was made to modify Eakins' system to 
include the different view of three-dimensional stored object in the database as taught 
by Eraslan in order to provide a faster search and retrieval system. Furthermore, 
Haruo also discloses providing a plurality of stored image representations of tree- 
dimensional objects, each image representation being associated with an object 
descriptor, each object descriptor including a plurality view descriptors, each view 
descriptor of representing the outline of the shape of a projection of each one of the 
three-dimensional objects from a different perspective view of the three-dimensional 
object (page 5, paragraph 0042). This suggests the object having different shapes. 
Therefore, it would have been obvious to one ordinary skill in the art at the time of the 
invention was made to modify Eakins and Eraslan to include each view descriptor 
representing an shape of an object as disclosed Haruo in order to allow the retrieval of 
an image using shape. 

Regarding on claim 7, Eakins a query is input in the form of two or more two- 
dimensional outlines of an object, and wherein a query view descriptor is derived for 
each said outline, and wherein the step of comparing comprises comparing each said 
query view descriptor with each view descriptor in each stored object descriptor to 
derive a plurality of view similarity values (page 4 of 9, lines 33-37). 
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Regarding on claim 8, Eal<ins teaclies tlie view-similarity values are analyzed to 
derive object similarity values (page 4 of 9, lines 33-37). 

Regarding on claim 9, Eakins teaches at least some of the object descriptor 
include view-independent descriptors which are related to shape/or size of the object, 
and wherein the method comprises inputting a view-independent query value and the 
step of comparing compares the query value with the view-independent descriptors for 
the stored object descriptor (page 4 of 9, lines 33-37). 

Regarding on claim 10, Eakins teaches the query descriptor is derived using a 
curvature scale space representation of the query object outline (page 4 of 9, lines 33- 
37). 

Claim 33 is rejected under the same reason as claim 6. 

Regarding on claim 34, Eakins teaches the query descriptor is derived using a 
curvature scale space representation of an outline of the query object (page 4 of 9, lines 
33-37). 

Regarding on claim 35, Eakins teaches the stored descriptor is derived using a 
curvature scale space representation of an outline of the three-dimensional object (page 
4 of 9, lines 33-37). 

Claim 36 is rejected under the same reason as claim 6. 

Regarding on claim 37, Eakins teaches selecting and displaying includes 
selecting and displaying an image representation of an object having a different view 
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from perspective view of said query object based on said query object matcliing witli at 
least two view descriptors including a view descriptor not representing perspective view 
of the object in the image representation (page 4 of 9, lines 33-37). 

Regarding on claim 38, Eakins teaches one of the view descriptors corresponds 
to a view of the object as the object appears in the respective image representation 
(page 4 of 9, lines 33-37) 

Regarding on claim 39, Eakins teaches one of the view descriptors corresponds 
to a perspective view of the object different from the perspective view of the object as 
the object appears in the respective image (page 4 of 9, lines 1 1 -1 4). 

Regarding on claim 40, Eakins teaches selecting include selecting and displaying 
an image representation including an object having a different perspective view from 
perspective view of said query object based on said query object matching with at least 
two view descriptors including a view descriptor not representing view of the object in 
the image (page 4 of 9, lines 33-37). 

Regarding on claim 41 , Eakins teaches each said view descriptor is a different 
representation of the object from a different perspective view of the three-dimensional 
object (page 4 of 9, lines 33-37). 

Conclusion 

4. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Baoquoc N. To whose telephone number is at 571-272- 
4041 or via e-mail BaoquocN.To@uspto.gov. The examiner can normally be reached 
on Monday-Friday: 8:00 AM - 4:30 PM, EST. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Breene can be reached at 571-272-4107. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is (703) 305- 
3900. 

Any response to this action should be mailed to: 
Commissioner of Patents and Trademarks 
Washington, D.C. 20231. 

The fax numbers for the organization where this application or proceeding is 
assigned are as follow: 

(571 ) -273-8300 [Official Communication] 

/Baoquoc N To/ 

Primary Examiner, Art Unit 2162 
July 6'^ 2008 



